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■ Abstract 



We prove that every automorphism of the category of free Lie algebras is a semi-inner 
automorphism. This solves the problem 3.9 from [19] for Lie algebras. 

Introduction 

We start from an arbitrary variety of algebras 0. Let us denote the category of free in algebras 
F = F(X), where X is finite, by 0°. In order to avoid the set theoretic problems we view all X 
as subsets of a universal infinite set X°. 

Our main goal is to study automorphisms ip : 0° — > 0° and the corresponding group 



> 

Aut0° for various 0. 



In this paper we consider the case when is the variety of all Lie algebras over an infinite 

CN ■ field P. Our aim is to prove the following principal theorem: 
O 



Theorem 1 Every automorphism of the category of free Lie algebras is a semi-inner automor- 
phism. 

This Theorem solves the problem 3.9 from [19] for the case of Lie algebras. 

Our primary interest to automorphisms of categories raised from the universal algebraic 
geometry (see [31], [30], [28], [29], [26], [4], [2], [3], [22], [23], [37], etc). The motivations we keep in 
mind are inspired by the following observations. 

Some basic notions of classical algebraic geometry can be defined for arbitrary varieties 

of algebras 0. For every algebra H € one can consider geometry in over H. This geometry 

gives rise to the category Ke(H) of algebraic sets in affine spaces over H [31]. The key question 

in this setting is when the geometries in defined by different algebras H\ and H2 coincide. The 

coincidence of geometries means for us that the corresponding categories of algebraic sets Ke(Hi) 

and Ke(H2) are either isomorphic or equivalent. 

1 This work is partially supported by the Emmy Noether Institute for Mathematics and the Minerva Foundation 
of Germany, by the Excellency Center of the Israel science Foundation "Group Theoretic Methods in the Study of 
Algebraic Varieties" and by INTAS 00-566 
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It is known that the conditions on Hi and H 2 providing isomorphism or equivalence of 
the categories Ke(Hi) and Ke(H 2 ) depend essentially on the description of the automorphisms of 
the category 9° (see [31], [19]). This explains the interest to automorphisms of categories of free 
algebras of varieties. 

Let F = F(X) G 6 be a free algebra, i.e., an object of the category 6°. The group 
Aut(0°) is tied naturally with the following sequence of groups: 

Aut(F), Aut(Aut(F)), Aut(End(F)) 

The groups Aut(F) are known for the variety of all groups (Nielsen's theorem, [15]), for the variety 
of Lie algebras (P.Cohn's theorem, [7]), for the free associative algebras over a field when the 
number of generators of F is < 2 ([8], [18], [9], [25]) and for some other varieties. For free associative 
algebras with bigger number of generators the question is still open (see Cohn's conjecture [8]). The 
groups Aut(Aut(F)), Aut(End(F)) are known for the variety of all groups [10], [12], [33], and due 
to E.Formanek every automorphism of End(F) is inner. The groups Aut(Aut(F)), Aut(End(F)) 
are also known for some other varieties of groups and semigroups [20], [35], [36], [11], [34]. 

Suppose that a free algebra F = F(X) generates the whole variety G. In this case 
there exists a natural way from the group Aut(End(F)) to the group Aut(6°). Thus, there is a 
good chance to reduce the question on automorphisms of the category B° to the description of 
Aut(End(F)). 

Aut(F) is the group of invertible elements of the semigroup End(F). Every automor- 
phism ip of the semigroup End(F) induces an automorphism of the group Aut(F). This gives a 
homomorphism r : Aut(End(F)) — > Aut(Aut(F)). The kernel of this homomorphism consists of 
automorphisms acting trivially in Aut(F). These automorphisms are called stable. We will prove 
that 

1. The homomorphism r is not a surjection. 

2. If X consists of more than 2 elements then r is an injection. 

3. If X consists of 2 elements then Kerr consists of scalar automorphisms (see Sections 2, 3). 

The paper is organized as follows. In Section 1 we give the definitions of inner and 
semi-inner automorphisms of a category. In Section 2 the notations are introduced. Section 3 is 
dedicated to linearly stable automorphisms and we prove that every linearly stable automorphism is 
inner. In Section 4 we define the notion of a quasi-stable automorphism and prove that every quasi- 
stable automorphism is inner. In Section 5 we prove that every automorphism of the semigroup 
of endomorphisms of the free two generator Lie algebra is semi-inner. In Section 6 we prove the 
general reduction theorem for a large class of varieties and reduce the problem about Aut(0°) 
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to the description of Aut(End(F(x,y)). Section 7 is dedicated to the proof of the main theorem. 
Finally, in Appendix we prove some auxiliary statements used in the text. 



1 Inner and semi-inner automorphisms of a category 

Recall the notions of category isomorphism and equivalence [21]. A functor p : C\ — ► C2 is called an 
isomorphism of categories if there exists a functor ip : C2 — > C\ such that ip(p = 1^ and pip = lc 2 , 
where \q x and 1q 2 are identity functors. 

Let (p±, <p2 be two functors C\ — > C2. An isomorphism of functors s : p\ — > 992 is defined 
by the following conditions: 

1. To every object A of the category C\ an isomorphism 5,4 : 991(A) — > 992(A) in C2 is assigned. 

2. If f : A — > i? is a morphism in C\ then there is a commutative diagram in C<i~- 

p 1 (A) 992(A) 

^(B) ^(S) 
The isomorphism of functors p\ and 992 is denoted by tpi ~ 992. 

The notion of category equivalence generalizes the notion of category isomorphism. A 
pair of functors 99 : C\ — > C2 and -0 : C2 — ► Ci define a category equivalence if — lei an d 
99-0 — lc 2 • If Ci = C2 = C then we get the notions of automorphism and autoequivalence of the 
category C. 

Definition 1.1 An automorphism 99 of the category C is called inner if there exists an isomorphism 
of functors s : \q — > p. 

This means that for every object A of the category C there exists an isomorphism sa ■ 
A — > 99(A) such that 

= sb^ 1 : 99(A) -> 99(B), 

for any morphism ^ : A — > i? in C. 

For every small category C denote the group of all automorphisms of C by Aut(C) and 
denote its normal subgroup of all inner automorphisms by Int(C). 

From now on and till Section 5 will denote the variety of all Lie algebras over the field 
P. Correspondingly, 0° is the category of free Lie algebras over P. 

Define the notion of a semi-inner automorphism of the category 0°. Consider, first, 
semimorphisms in the variety G. A semimorphism in O is a pair (a, u) : A — ► B, where A and B 
are algebras in 0, v : A — > B a homomorphism of Lie rings, a an automorphism of the field P, 
subject to condition v(\a) = a(X)v(a), where A € P, a £ A. If a = 1 then v is a homomorphism 
of Lie algebras and we write it as (1, v). Semimorphisms are multiplied componentwise. 
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Thus, if n : A — > B is a homomorphism, and {a,v\) : A — > A l5 (cr, f 2 ) : P — > Pi are 
semi-isomorphisms, then 

(cr, ^ 2 )(i,Ai)(o-,^i) _1 = ((o-^xi^Xo-^Vr 1 ) = (i^/^r 1 )- 

This means that V2\iv : [ V : A\ — > Pi is a homomorphism of Lie algebras. 

Definition 1.2 ^4n automorphism 92 0/ i/ie category ©° is called semi-inner, if for some a E 
Aut(P) i/iere is a semi-isomorphism of functors (<j, s) : l e o — > 99. 

This definition means that for every object P € 0° there exists a semi- isomorphism 
(cr, sp) : F — > 93(F) such that 

¥>(") = SF 2 vSpl : ^(Fi) -» y>(F 2 ), 

for any morphism ^ : Pi — > F 2 in 0°. 

Let now a be an arbitrary automorphism of the field P. We will construct a semi-inner 
automorphism a of the category 6°. Consider an arbitrary free finitely generated Lie algebra 
F = F(X) and fix a Hall basis in F [1],[6]. It can be shown [6] that if u,v are two elements 
of a Hall basis then [u,v] is presented via elements of this basis with the coefficients (structure 
constants) belonging to the minimal subfield of the field P. Define a map op : F — > F. Every 
element w of F has the form: 

w = \ lUl -1 h \ n u n , 

where \ G P and Uj belong to the Hall basis of F. Define 

a F (w) = a(Xi)ui H h cr(A n )u n . 

We show that (cr, a F ) is a semi-automorphism of the algebra F. It is clear that a F 
preserves the addition, and that a F (Xw) = a(X)a F (w). It remains to check that a F preserves the 
multiplication. Let w\ = J2i ctiUi, and u? 2 = J2j a j u j- Take [m, Uj] = J2k n% k u% k ■• where belong 
to a minimal subfield . Then 

[wi,w 2 ] = ^aiPj[ui,Uj] = a iPj nl k ul k- 

Apply a F , then 

a F [w 1 ,w 2 ] = J2<T(a i )a(P j )n)?u)?, 
i,j,k 

since the automorphism a does not change the elements of a prime subfield. On the other hand 
[<T F (w 1 ),a F (w 2 )] = ] ^u{a i )u i ^a{l3 j )u j ] =^2a(a i )a(/3 j )[u i ,u j ] = ^u{a i )u{(3 j )n\ :i u\ 3 . 

i j i,j i,j,k 
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We verified that the pair (a,ap) defines a semi-automorphism of the algebra F. Note that ap 
does not change variables from X and does not change all commutators constructed from these 
variables. 

Now we are able to define the automorphism a of the category 6°. This automorphism 
does not change objects and a(u) = <jf 2 v &f\ '■ F\ — > F2 for every morphism v : F\ — > Fi. It is 
easy to check that if p is an arbitrary semi-inner automorphism of 6° for the given a G Aut(P) 
then there is a factorisation ip = po&i where <po is an inner automorphism. 

The same scheme which was applied for the definition of semi-inner automorphisms of the 
category 0° works for the definition of semi-inner automorphisms of the semigroup End(F), where 
F is a free finitely generated Lie algebra. An automorphism p of End(F) is called a semi-inner 
automorphism if there exists a semi-automorphism (a,s) : F — > F such that ip{y) = sus^ 1 for 
every v G End(F). The factorisation ip = po&, where po is inner holds also in this case. 

2 Notations and preliminaries 

Let X be a finite set. Denote by F{X) the free Lie algebra over an infinite field P generated by 
the set X of free generators. The Lie operation is denoted by [, ]. Denote the group of all non zero 
elements of P by P*. We denote the semigroup of all endomorphisms of F{X) by End(F(X)). Any 
endomorphism of F(X) is uniquely determined by a mapping X — > F(X). Therefore, we define an 
endomorphism p of F(X) by defining p{x) for all x G X. Denote the group of all automorphisms 
of F(X) by Aut(F(X)). 

We fix a basis, say the Hall basis in F(X) and consider the presentations of elements of 
F{X) in this basis. Denote the length of a monomial u G F(X) by \u\, we call it also the degree of 
u. Denote the set of all elements of X included in u by x( u )- The set x( u ) is a support of element 
u, which is uniquely defined by the presentation of u in the fixed basis. Denote the number of 
occurrences of a letter x in u by l x (u)- Let p G F(X). Denote the degree of the polynomial p by 
deg{p). Denote the cardinality of the set X by \X\. 

Let us denote the semigroup of all endomorphisms <p G End(F(X)) which assign a linear 
polynomial from F{X) to any x G X by End;(F(A)). Denote the group of the linear automor- 
phisms of F(X) by Anti(F(X)). 

Let X = {x\ . . . x n }. If p is linear then p{xi) = anx\ + • • • + ai n x n , where a^- G P. This 
means that a linear automorphism is defined by its matrix of coefficients. The multiplication of 
linear automorphisms corresponds to the multiplication of their matrices. Thus, the semigroup 
End;(i ? (X)) is isomorphic to the matrix semigroup M n (P). The scalar matrix corresponds to the 
linear automorphism, defined by f a {xi) = axi. Therefore, automorphism f a commutes with all 
linear endomorphisms. However, it does not commute with an arbitrary endomorphism. 

Denote the endomorphism of F(X) which assigns the same p G F(X) to any x G X by 
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Cp. All endomorphisms of the type c p form a subsemigroup Cp of End(F(X)). Let us denote the 
subsemigroup of Cp consisting of all endomorphisms of the type c u where a £ I by Cx- Let 
C = Cf n End/(F(A)). C\ consists of all endomorphisms of the type c p G Cf where p is a linear 
polynomial. 

Definition 2.1 An automorphism £ G Aut(End(F(X))) w/tic/i acte identically on Auti(F(X)), is 
called a linearly stable automorphism o/End(F(X)). 

3 Linearly stable automorphisms of End(F(X)) are inner 

In this section we prove that the semigroup of all constant endomorphisms is invariant in 
respect to the action of any linearly stable automorphism of End(F(X)) and that any linearly 
stable automorphism acts identically on the semigroup Endi(F(X)) of all linear endomorphisms. 
Then we prove that any linearly stable automorphism of End(F(X)) is an inner automorphism. 

Lemma 3.1 Let £ be a linearly stable automorphism o/End(F(X)). Then £(Cf) = Cf- 

Proof. Take u G F(X), c u G Cf- Consider g G Auti(F(X)) such that g(x) = y,g(y) = x, and 
g(z) = z for any z G X distinct from x and y. Then c u g = c u and £(g) = g. Hence, £(c M )(x) = 
t(cug)(x) = £{c u )£(g){x) = £{c u ){y) = v. Thus, £(c M ) = c v G C F - Therefore, £{C F ) C C F . 
Similarly, ^{Cp) C C F . Hence, £(C F ) = C F . □ 

Lemma 3.2 Let £ £ Aut(End(F(X))) be a linearly stable automorphism. Let £(c p ) = c q . Then 
x(p) = x(q) (polynomials p and q are constructed from the same variables). 

Proof. Suppose that x G x{p) \ x{q)- Let a G P be an element of infinite order (torsion free). 
Consider g a G Autj(F(X)), which assigns ax to x and assigns z to z for any z£l different from 
x. Then g a (p) = w ^ p (indeed all elements of the basis are linearly independent and a is torsion 
free) and g a (q) = q. Therefore, g a c p = c w ^ c p . On the other hand, 5,{g a c p ) = £,{g a )i{c p ) = g a c q = 
c q = £(cp). It contradicts to injectivity of £. The similar reasoning can be applied to x G x(l)\x(p) 
as well. Thus, x{o) = x{p)- a 

Lemma 3.3 Any linearly stable automorphism £ o/End(F(X)) acts identically on Cx- 

Proof. It is obvious that any c x G Cx is a right identity of C F . Therefore, £(c x ) = c p G Ci? 
(Lemma 3.1) and £,(c x ) is a right identity of Cf- Hence, c x c p = c x . It follows from Lemma 3.2 and 
identity [xx] = that p = ax, a G P. Therefore, c x c p = c p . Thus, £(c x ) = c p = c x . □ 

Lemma 3.4 For any linearly stable automorphism £ o/End(F(X)) and for any ip G End(F(X)) 

^(^(x)) = c 5(v)W- 
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Proof. We have <pc x = c v{x) . Then ^(c^ x) ) = £,(<pc x ) = £((f)c x = c^^y □ 

Lemma 3.5 Any linearly stable automorphism £ q/End(F(X)) acts identically on End;(F(A)). 

Proof. Let us prove first that £ acts identically on C\. Let c p G C/, where p is a linear polynomial. 
Let g G Auti(F(X)) be defined by g{x) = p, x G x(p)> an d = 2/ f° r an Y other y £ X. It follows 
from Lemma 3.3 that £,(c x ) = c x . Therefore, gc^ = c p and £(c p ) = £(<7)£( c rr) = S'Cx = <V 

Hence, c^) = ^(c^)) = £(<p)c x = Cf. {v){x) , for any ip G Endi{F{X)) . Thus, £(p)(x) = 
<p(x). □ 

Lemma 3.6 Let £ € Aut(End(F(X))) be a linearly stable automorphism. Let £(c p J = c qi and 
ai£ P fori = 1,2,..., k. Then £(c am+ ... +afcPfc ) = c aiqi+ ... +akqk . 

PROOF. It follows from Lemma 3.5 that £,{c ax ) = c ax . Therefore, £(c aPi ) = i{c Pi c ax ) = c qi c ax = 

Define ip G End(F(X)) as follows ip(x) = pi,(p(y) = p2- Then c Pl+P2 = ipc x+y . It 
follows from Lemma 3.4 that £(ip)(x) = gi and £(ip)(y) = qi- It follows from Lemma 3.5 that 
£{c x+y ) = c x+y . Therefore, £(c Pl+P2 ) = £(ip)c x+y = c qi+q2 . 

Let us prove that £(c am +... +afcPfc ) = c aiqi+ ... +akqk by induction on k. We have proved 
above the basis of the induction: £(c aipi ) = c aiqi . Assume that the statement is true for k < t. 
It follows from the assumption of the induction that ^(ca lP1 +...+at-ipt-i) = c a 1 q 1 +...+a t - 1 q t -i an d 

C{ c a t pt) = c atqt- C{ c p+p') = c q+q' ■ Therefore, C( c a 1 p 1 +...+a t pt) = c aiqi+...+a t qt • ^ 

Lemma 3.7 Let £ £ Aut(End(F(X))) be a linearly stable automorphism. Then ^{cy xi )X2 ]) = 
c a[x 1 ,x 2 ]> where a G P and a / 0. 

Proof. Suppose that £(c[ xl)X2 ]) = c f- 

Denote the endomorphism generated by the mapping Xi — > aiXi by T ai ... an . It follows 
from Lemma 3.5 that £(r ai ... a J = T ai ... ari . Therefore, £(r ai .. c/. Hence, 

£fcaia2[xi,*a]) = c r ai ... an (f)- It follows from Lemma 3.6 that f (Paio2[xi,x a ]) = c aia 2 /- Thus, 01O2/ = 

T ai ...a n (/)• 

Suppose that / = + ... + a^/t is the decomposition of / with respect to the basis of 
Hall. Observe that the decomposition of r ai ... an (/) contains the same elements of the basis as the 
decomposition of / but with different coefficients. Elements of the basis are linearly independent 
over P. Therefore, we obtain a system of equations of the form (a 1 1 ...a n n — a\a2)oii = from the 
equation a\a<if = T ai ... an (/). For the element [xi,X2] of the basis we get the equation (a\a<i — 
0102)0 = 0. In all other cases it is easy to find ai,...,a n such that (a^-.-an" — 0102) 7^ (for 
example, if char(P) ^ 2, take Oi = 02 = ... = a n = 2 for the monomials with the number of 
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multipliers different from 2 and take a\ = 02 = 2,03 = ... = a n = 1 for monomials [xj,Xj], where 
{i,j} 7^ {1,2}). Hence, all coefficients «j are equal to zero except the coefficient of the monomial 
[x 1 ,x 2 \. □ 



Let a G P*. Consider a scalar automorphism f a of F(X) defined by the rule f a {x) = ax, 
for every x G X. It defines an inner automorphism f a of the semigroup End(F(X)) by the rule 
faif) = faPfa 1 - fa acts trivially on End/(F(X)). Thus, /„ is linearly stable. 

Proposition 1 Lei £ € Aut(End(F(X))) be a linearly stable automorphism. Then there exists 
a G K such that £ = f a . 

Proof. Let £(c[ xljX2 ]) = c a[xi,x 2 ]- Take the scalar automorphism f a corresponding to the element 
a. Consider the bijection F(X) — > which multiplies a monomial of the length n on a n_1 . 

Suppose p is a polynomial presented as the sum of its homogeneous components: p = p\ + ... + p s , 
where deg(pi) = i or pi = 0. Denote p\ + ap2 + ■■■ + a s ~ 1 p s by p. Let us prove that £(c p ) = Cp for 
any c p G by induction on the number r of monomials of the polynomial p. 

Let us prove the base of the induction for r = 1 by induction on the degree of the monomial 
p = u. The base of this induction follows from the Lemma 3.5. Suppose that £(c u ) = c a i-i u for any 
u such that \u\ = I < k. Suppose now that \u\ = k and u = [1*1,1*2], where |«i| = k\ and \u2\ = &2- 
Let <p(xi) = u\,ip(x2) = U2 and (p(x) = x for any other x G X. Then <pc[ XljX2 j = c u . It follows 
from the assumption of the induction that £(c Ml ) = c^-i^ , £(c U2 ) = c a fc 2- 1 U2 an( ^ ?( c ^) = c % f° r 
any x G X. Therefore, it follows from Lemma 3.4 that £(tp)(x) = tp(x) for any x G X. Hence, 
£(cu) = £(¥>c [xijX2 ]) = £(<£>)c a[xi!X2 ] = ^(^(a^^^j) = c^j-i^^-i^j = c a fc-i u = c^. Thus, we 
proved the basis of the first induction for r = 1. 

Suppose that £(c p ) = Cp for any p G -F(A) which contains less than k monomials. Suppose 
now that p contains k monomials and p = q + g where each of the polynomials q and g contains 
less than k monomials. It follows from the assumption of the induction that £(c q ) = c q , £(c ff ) = Cg 
and £(c x ) = c x for any x G X. Hence, it follows from Lemma 3.6 that £(c p ) = ^{c q+g ) = c q+g - = Cp. 
Thus, £(cp) = Cp for any p G F(X). 

In particular, = £(tpc x ) = ^(^(x)) = <^v) for ever Y ¥ G End(F(X)). Thus, 

£(<^)(x) = <£>(x). On the other hand it is easy to see that f a ((f)(x) = <p(x). Therefore, £((/?) (x) = 
f a (ip)(x). This equality holds for every x G X and every </? G End(F(X)). Thus, £ = f a . □ 

Corollary 3.8 ylny linearly stable automorphism o/End(F(X)) is inner. 

Remark 3.9 1. Let \X\ > 2. Consider the automorphism ip G Aut(F(X)) defined by ip(x) = 
x+[y,z], <p acts identically on the rest of variables from X . Then f a ((p)(x) = x+a[y,z]. Therefore, 
the linearly stable automorphism f a for a^l does not act identically on the group Aut(F(X)). 
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2. Let X = {x,y}. Then Auti(F(X)) = Aut(F(X)) [8]. In this case the automorphism 
f a acts identically on the group Aut(F(X)). However, i/a / 1 then f a does not act identically 
on the semigroup End(F(X)). Indeed, take an endomorphism (p such that <p(x) = [x,y]. Then 
f a (f){x) = a[x,y\. 

Proposition 2 Let \X\ > 2. If £ is a stable automorphism (acts identically on Aut(F(X)) / ) then 
£ acts identically on End(F(X)). 

Proof. It follows from Remark 3.9 that if |X| > 2 then £ = f a is a stable automorphism if and 
only if a = 1. This proves the proposition. □ 

We say that an automorphism / of Aut(F(X)) is an extendable automorphism if there 
exists an automorphism g of End(F(X)) whose restriction to Aut(F(X)) is /. It is obvious that all 
extendable automorphisms of Aut(F(X)) form a subgroup of Aut(Aut(F(X))). This subgroup is 
the image Jm(r) of a homomorphism r defined in the introduction. 

Corollary 3.10 // \X\ > 2 then the group Aut(End(F(X))) is isomorphic to the subgroup of 
Aut(Aut(F(X))) consisting of all extendable automorphisms. 

4 Quasi-stable automorphisms of End(F(X)) 

In this section we define the notion of the quasi-stable automorphism of End(F(X)) and prove that 
any quasi-stable automorphism of End(F(X)) is inner. 

Define, first, the diagonal automorphisms of the group Aut;(F(X)). We proceed from the 
canonical isomorphism S : Auti(F(X)) — > GL n (P), n = \X\. Consider the commutative diagram 

AuU(F(X)) — GL n (P) 
p* 

Define h\{A) = h\(A)A, for every matrix A E GL n (P). Then h\ is an automorphism of GL n (P). 
It corresponds to the automorphism h of Auti(F(X)) defined by h = 5~ l h\5. It is easy to see that 
h(g)(x) = h{g)g{x) for every g € Autj(F(X)) and every x G X. The automorphisms h and hi are 
called diagonal automorphisms. 

Definition 4.1 An automorphism £ € Aut(End(F(X))) is called quasi-stable if the group Auti(F(X)) 
is invariant in respect to £ and the restriction of £ to Auti(F(X)) is a diagonal automorphism. 

Denote the restriction of £ to Auti(F(X)) by To(£). Then To(£) = h for some homomorphism 
h : Auti(F(X)) -» P*. 
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If h(g) = 1 for every g then the automorphism £ is linearly stable. We show that every 
quasi-stable automorphism £ turns out to be a linearly stable automorphism. 

Consider the case X = {x,y}. In this case Aut(F(X)) = Auti(F(X)) (see [8]). Thus, 
we do not need the assumption that £ leaves Aut/(F(X)) invariant, and To(£) = t(£) where 
r : Aut(End(F)) — > Aut(Aut(F)) is the homomorphism defined in the introduction. 

Remark 4.2 For the case \X\ > 2 we also could proceed from the homomorphism h : Aut(F(X)) — > 
P*. However, in this case the corresponding h is not an automorphism o/Aut(F(X)). 

Let To(£) be equal to /i. Denote the automorphism defined by the mapping g(x) = y, 
g(y) = x and g(z) = z for the rest of elements of X by g xy . Denote h(g xy ) = a xy . Notice 
that g xy = e. Therefore, a xy = 1. Since P does not contain zero divisors a xy = ±1. Denote 
ip G Endi(F(X)) such that (p(x) = x and <p(y) = a xy x for any other y G X by /. 

Lemma 4.3 Zei ^ be a quasi-stable automorphism o/End(F(X)). T/ien £(c u ) = c^Z, where I G 
Endi(F(X) is defined above. Thus, €(Cp) = Cpl. 

Proof. Let 5^ G Aut(F) and £(g xy ) = a xy g xy . c u = c u g xy . £(c u ) = i{c u )a xy g xy . Let 
£{c u )(x) = v. Therefore, for any y G X £(c u )(y) = a x?/ £(c u )(x) = c„Z(y). Thus, £(c u ) = cj. □ 

Lemma 4.4 Let £ be a quasi-stable automorphism o/End(F(X)). Then for any x,y G X £(c x ) = 
c x and i{g xy ) = g xy . 

Proof. Let c x G Cx- It follows from the previous Lemma that £(c x ) = c p l for some p G F{X). 
Let p = ax + b\yi + ... + b^Vk + Pi, where p\ is a non-linear polynomial. c x is a right identity in the 
semigroup Cp for any c x G Cx- Therefore, £(c x ) is a right identity for Cp. Hence, c x £(c x ) = c x . 
Consequently, c^ a+ h 1+ ,,, + b k )x^ = c x- Therefore, a + b\ + ... + bk = 1 and I is the identical mapping. 
Thus, £,{g xy ) = g xy for any x,y e X. 

Let <7 m?; be the automorphism defined by the mapping g my (x) = x and g my (y) = my for 
y ^ x, y e X and let h(g my ) = d m ^ 0. Then c^c^ = c^. Therefore, £{g my c x ) = d m g my c p = 
£( c a;) = c p- Hence, d m g my {p) = p. Remind that we present p in the basis of Hall of linearly 
independent elements. Thus, we obtain a system of equalities of corresponding coefficients. d m a = 
a,d m mbi = bi, .... If a ^ then d m = 1. Choosing m ^ ±1 we obtain that all other coefficients of 
p are equal to 0. In particular, a = 1. Thus, in this case £(c x ) = c x . 

Suppose now that a = 0. Then &i + ... + bk = 1 and p = b±yi + ... + bkyk +P\- Let be 
the automorphism generated by the mapping g' my {x) = x and g' my {y) = my + x for y ^ x, y G X 
and let h(g' rny ) = d' m ^ 0. Then c/^c^ = c x . Therefore, £(5mj, c x) = d' m g' my c p = f(c x ) = c p . Hence, 
d' m g' m y(p) = P- Comparing the coefficients of x we obtain that d' m (b\ + ... + bk) = d' m = 0. But 
this is impossible. Thus, this case is impossible. Hence, £(c x ) = c x . □ 
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Lemma 4.5 Let £ be a quasi-stable automorphism o/ End(F(X)), t (£) = h. Let Endi(F(X)) be 
the subsemigroup of all linear endomorphisms. Then £(Endi(F(X))) = Endi(F(X)). 

Proof. Let p be a linear polynomial. We proved above that £(c p ) = c q , p,q G F(X). Let g p 
be the automorphism defined by the mapping g(x) = p and g(y) = y for y ^ x, y G X. Then 
c <? = £( c p) = = Hg)g£(c x ) = c h ( g ) g ( x ) = c h (g) P - Hence, q = h(g)p is a linear polynomial as 

well. Let (p G Endi(F(X)). £(c v{x )) = £{<pc x ) = £(<p)£{c x ) = £{<p)c x = c^ ){x) . Since <p(x) is a 
linear polynomial, £(tp)(x) is a linear polynomial as well. Thus, G Endi{F(X)). □ 

The following Proposition can be obtained as a corollary of the previous Lemma and the 
description of automorphisms of the linear semigroup obtained by L.Gluskin in [13] but we give 
an independent proof. 

Proposition 3 Any quasi-stable automorphism £ o/End(F(X)) is linearly stable. Thus, £ is inner. 

Proof. To prove the Proposition is enough to prove that a quasi-stable automorphism acts 
identically on Endi(F(X)) and then use Corollary 3.8. 

Let p be a linear polynomial. Let a be the sum of all coefficients of p. It follows from 
the proof of Lemma 4.5 that £(c p ) = Ck p , where k G P*. It follows from the proof of Lemma 4.4 
that h(g my ) = d m = 1, where g my is the automorphism generated by the mapping g my (x) = x and 
9my(y) = my for y ^ x, y G X. Thus, £(c x c p ) = ^{c ax ) = £{c x g ay c y ) = c x g ay c y = c ax . On the 
other hand (,(c x c p ) = £,(c x )£,(c p ) = c x c^ p = c a k x - If a ^ then k = 1, that is £(c p ) = c p . If a = 
then consider g my such that the sum a' of all coefficients of g m y(p) is not equal to 0. Then as we 
have proved above g my c p = £,(g my c p ). Therefore, g my c p = i{g my c p ) = g my S,(c p ). Since g my is an 
automorphism of F(X) then £(c p ) = c p . 

Thus, £ acts identically on C/. Let 99 G Endi{F{X)). = ^(c^^) = £,(<pc x ) = 

Z(<p)t,(.c x ) = £{<p)c x = C(. {v){x) . Thus, £(<£>)(z) = Hence, f (y>) = 99. □ 

5 Automorphisms of End(F(X)) 

In this section we prove that any automorphism of End(F(x, y)) is semi-inner. 

Theorem 2 Any automorphism of End(F(x, y)) is a semi-inner automorphism. 

PROOF. P.Cohn [7] proved that the group Aut(F(X)) is generated by linear and triangular au- 
tomorphisms. Triangular automorphisms assign axi + f(x±, to x.- L . Hence, for X = {x,y} 
(X consists of two elements), a triangular automorphism assigns ay + f(x) to y. A Lie polyno- 
mial of one variable is a linear polynomial. Therefore, the group Aut(F(x, y)) consists of linear 
automorphisms only. Thus, Aut(F(x, y)) is isomorphic to GL^P)- Let 5 : Aut(F(x, y)) — > GL2(P) 
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be an isomorphism. Then v — > b~ x vb defines an isomorphism Aut(GL 2 (P)) — > Aut(Aut(F(x, y))). 
If 1/ € Aut(GL 2 (P)) is semi-inner then 5~ 1 vS is a semi-inner automorphism of Aut(F(x, y)). If 
v € Aut(GL2(P)) is diagonal then b~ x vb is a diagonal automorphism of Aut(F(x, y)). It is well 
known ([24]) that the group of automorphisms of GL 2 (.P) is generated by semi- inner and diagonal 
automorphisms. Hence, the group of automorphisms of Aut(F(x, y)) is generated by semi-inner 
and diagonal automorphisms. 

Let £ be an automorphism of End(F(X)). In the introduction we defined a homomorphism 
r : Aut(End(F(X))) -► Aut(Aut(F(X))), where r(£) = £ r is the restriction of £ to Aut(F(X)). 
Hence, r(£) is a product of semi-inner and diagonal automorphisms of Aut(F(X)). Since a diago- 
nal automorphism commutes with a semi- inner automorphism we obtain t(£) = t; s £,d, where £ s is 
a semi- inner automorphism and £<f is a diagonal automorphism of Aut(F(X)). £ s is a semi-inner 
automorphism of Aut(F(X)) defined by a semi-automorphism / of F(X). f defines an automor- 
phism £1 of End(F(X)). Thus, £ s = £{. Then £f 1 £ = £ 2 is an automorphism of End(F(X)) and 
£2 = id- Thus, £ 2 is a quasi-stable automorphism. It follows from Proposition 3 that £ 2 is inner. 
Consequently £ = £i£ 2 is semi-inner as a product of semi-inner automorphisms. □ 

Now we formulate an application of Theorem 2. First, we consider two problems. Let 
iq and F 2 be free Lie algebras over a field P. Suppose that the semigroups of endomorphisms 
End(Fi) and End(F 2 ) are isomorphic. Does this imply the isomorphism of algebras iq and F 2 ? 
Let £ be an isomorphism of End(Fi) and End(F 2 ). In which cases one can state that there exists 
an isomorphism or a semi-isomorphism / : iq — > F 2 which induces £, i.e., £(99) = /V/ _ for every 
ip G End(Fi)? If / induces £ then the pair (/,£) defines the isomorphism or semi-isomorphism of 
the actions of the semigroup End(Fi)) on iq and End(F 2 )) on F 2 . 

Proposition 4 If F± = F(x,y) then for any isomorphism £ : End(Fi) — > End(F 2 ) i/iere exists a 
semi-isomorphism f : F\ — > F 2 which induces £. 

PROOF. Show that there exists an isomorphism iq — > F 2 . We have to show that if F 2 is freely 
generated by a set Y then |Y[ = 2. Isomorphism £ induces an automorphism of groups Aut(Fi) 
and Aut(F 2 ). The group Aut(Fi) contains a non-trivial center consisting of scalar automorphisms. 
If \Y\ / 2 then the group Aut(F 2 ) does not possess such a property. Thus, \Y\ = 2 and there is an 
isomorphism f\ : F\ — > F 2 . We change this /1 in order to get a desired semi- isomorphism /. Define 
fi : End(Fi) -» End(F 2 ) by the rule /i(y>) = /i^/f 1 for every ip £ End(Fi). The product /T^ 
is an automorphism of the semigroup End(Fi). Using Theorem 2 we get that this automorphism 
is semi-inner. Thus, /1 ^ = g, where g is a semi- automorphism of the algebra iq. Now £ = /ig. 
Semi-isomorphism / = fig : iq — > F 2 induces the initial £. □ 

Problem 5.1 Does i/ie theorem 2 admit a generalization for the case of arbitrary X, \X\ >2? 
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Proposition 5 The following conditions on a free Lie algebra F(X) are equivalent 

1. Any automorphism q/End(F(X)) is semi-inner. 

2. For any automorphism £ o/End(F(X)) the group ^(Auti{F (X))) is conjugated to Auti(F(X)) 
(in the group Aut(F(X))j. 

Proof. 

• 1 =>• 2 There exists a semi-inner automorphism (<r, g) of F(X) such that for any <p G 
End(F(X)) £(</?) = gapa' 1 g' 1 . For any a G Auti(F(X)) we have aaa' 1 G Auti(F(X)). 
Therefore, Auti(F{X)) and 5,{Auti{F{X))) are conjugated by g G Aut(F(X)). 

• 2 ^ 1 Let £ be an automorphism of End(F(X)). Auti(F(X)) and £(Auti(F(X))) are con- 
jugated by g G Aut(F(X)). 5 defines an inner automorphism g of End(F(X)). ^g^ 1 = £1 
is an automorphism of End(F(X)) which induces an automorphism £2 of Auti(F(X)). £2 
is semi-inner and, therefore, it is extended to semi-inner automorphism £2 of End(F(X)). 
Automorphism ^i^ 1 = £3 is a linearly stable automorphism of End(F(X)). Therefore, it is 
inner (see Corollary 3.8). Hence, £ = £i<? = £3^29 is semi-inner. 

□ 

6 Reduction theorem 

In this section we prove the general reduction theorem for a large class of varieties 0. This theorem 
allows to reduce the problem of the description of automorphisms of the category 0° to the same 
problem for a much simpler category (consisting of two objects). 

We assume that the variety satisfies the following 3 conditions. 

1. The variety is hopfian. This means that every object F = F(X) of the category 0° 
is hopfian, i.e., every surjective endomorphism v : F — > F is an automorphism. 

2. If X = {xq} is a one element set and Fq = F(xq) is the cyclic free algebra then for 
every automorphism ip of the category 0° we require <p(Fq) is also a cyclic free algebra F(yo). 

3. We assume that there exists a finitely generated free algebra F° = F(X°), X° = 
{xi, • • • , Xk}, generating the whole variety 0, i.e., = Var (F°). 

For the sake of convenience in this paper we will call a variety, satisfying these conditions, 
a hereditary variety. 

We fix F° and F . 

Proposition 6 [5], (see also Appendix). The conditions 1 and 2 imply that for every F = F(X) 
and every ip : 0° —> 0° the algebras F and (p(F) are isomorphic. 
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Lemma 6.1 [5] Any automorphism ip : G° — > B° such that algebras F and p(F) are isomorphic 
has the form 

p = tpotf!, 

where po is an inner automorphism of 0° and p\ does not change objects. 

Consider a constant morphism uq : F° — > Fq such that fo(x) = Xo for every x G X°. 

Theorem 3 (^Reduction Theorem ) Let p be an automorphism of the category 0° which does 
not change objects, and let p induce the identity automorphism on the semigroup End(F°) and 
tp(vo) = vq. Then (p is an inner automorphism. 

The proof of the Theorem consists of several steps. 

1. It will be convenient to attach to the category 0° the category of affine spaces Kq(H) 
over the algebra H = F° [31]. The objects of Kq(H) have the form Hom((F(X), H), where F is 
an object of the category 0°. Morphisms 

s : Hom((F(X),H) -» Hom((F(Y),H) 

are defined by morphisms s : F(Y) — > F(X) by the rule s{u) = vs for every u : F(X) — > H. 
We have a contravariant functor $ : 0° — > Kq(H). The condition Var(H) = implies that this 
functor yields the duality of the categories 0° and Kq(H) (see [31] and Appendix). Consider the 
automorphism p H of the category of affine spaces which is the image of p under the duality above. 
Functor p H : Kq(H) — > Kq(H) does not change objects and for s : F(Y) — > we define 

p H {s) = <p(s). This definition is correct, since si = s~2 implies S\ = S2- 

We will show that ip H is in a certain sense a quasi-inner automorphism. First of all, p 
defines a substitution on each set Hom(F(X),H). Indeed, v : F(X) — > H and : F(X) — > 
give rise to a substitution /ux defined by Hx{v) = <p(v). The following proposition explains the 
transition from 0° to Kq{H). 

Proposition 7 Lets: F(Y) -» T/ien 

^(s) = : Hom(F(X),H) -> Hom(F(Y),H). 

Proof. For every s : F(Y) — ► F{X) and every v : F{X) -> H the equality = = 

holds. Therefore, we have 

Hys^{v) = hy{^{v)s) = pip^i^s) = up(s) = p H {s){u). 

□ 

Remark 6.2 // the automorphism p H has a presentation above we call it quasi-inner. 
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Consider separately the case X = X° and take the substitution fi x o : Hom(F°,H) — > 
Hom(F°,H). By the condition of the theorem the equality /J- x o(v) = vW) = v holds for any 
v:F°->H = F°. This means that fi x o = 1. Then for s : F(Y) -> we have 

99^ (s) = HySH x \ = fiys = f(s). 

For s : F(X°) -> F(Y) we get 

Therefore, s = ip(s)[iy. 

2. Now we use the category of polynomial maps Pole(H). Objects of this category have 
the form H n , where n changes and H is fixed. Morphisms are represented by polynomial maps 
s a : H n -> H m defined below. Take a set X = {xi, ■ • • ,x„}. Denote ax : Hom(F(X),H) H n 
the canonical bijection defined by axC^) = (K^i), • ■ ■ j v(x n )) for every z/ : F(X) — > Let now 
s : — > F(X) be given and X = {xi, • • • , x n } Y = {y±, • • • , y m }- Consider the diagram 

Hom(F(X),H) —2— Hom(F(Y),H) 



a x 



ay 



where s a = aysa^ 1 ; 5 = «y 1 s Q! ax- Then s a (ai, • ■ ■ , a n ) = aysa x 1 (ai, ■ ■ ■ , a n ). Take a point 
v = a x 1 {a 1 ,---, an) : F(X) -» H. Then 

s a (ai, • • • , a n ) = ays» = a Y {vs) = (i>s(yi), • • • , vs{y m )). 

Denote s(yi) = u> i(x±, • • • , x n ), z = 1, • • • , m. We have got 

s a (ai, ■•• ,a n ) = (wi(ai, • • • ,a n ), • • ■ ,w m (ai,-- • ,a„)). 

Indeed, 

s a (ai, • • • ,a n ) = (z/(u>i(xi, • • ■ ,x n )), • • • , i/(iu m (xi, • • ■,!„))) = 
= (wifci, • • • ,<), • • • ,t« m (xi, • • ■ ,<)) = (tfi(ai, • • • ,a n ), • • ■ ,w m (ai,- ■ • ,a n )). 

Thus, we defined morphisms s a : H n — > in the category Pole(H). 

Consider special constant morphisms in the category 0°. First, take morphisms of the 
form: v = v a : Fq — > F(X) defined by v a {xo) = a, a G F(X). Recall that the constant morphism 
^0 : -F — > ^(#0) is defined by vq(x) = xo for every x G X°. 

Take f = z^ a ^o : F(X°) — > ^(-X"). Then z/(x) = a for every x G X°, and v is a constant 
we will be dealing with. 

Let, further, ip be an automorphism of 0° which does not change objects. This ip induces 
a substitution on each set Hom(F(X), F(Y)) denoted by nx,Y- In particular, fi xx o = \i x . The 
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substitution fJ, XOt x on the set Hom(F , F(X)) induces the substitution ax on the algebra F(X) 
defined by the rule <p(v a ) = v c x {a)- ^ i s proved [31] that for every fi : F(X) — ► F(Y) the formula 

(p(ji) = ay^x 1 

holds. In this sense the automorphism ip is said to be a quasi-inner automorphism in the category 
0°. Take now v = v a VQ. Then 

ip(v) = <p(v a )<p(v ) = u ax{a) <f(u ). 

If <p does not change v then 

For every x € X° we get ip(v)(x) = ax(a), here ip(u) is also a constant. 

Now we are in the position to make the next step. We return to the category of polynomial 
maps and consider how the constant maps defined above in 6° look like in Pole (H) . Take s : H = 
F(X°) = F° -» F(X) defined by s = s w u , w € F(X). Then s(x) = w for every x € X°. Let 
X° = {xi, • • • , Xfc}. We get the commutative diagram 

Hom(F(X),H) —2— Hom(F(X°),H) 

Then s a (ai, ■ ■ ■ , a n ) = (w(ai, • • • , a n ), • • • , w(ai, • • • , a n )), where u>(ai, • • • , a n ) is taken fc 
times. Considering the projection it : H k — > ff, 7r(6i, - - • , 6fc) = &i we get 7rs a (ai, • • • , a n ) = 
w(a u ■ ■ ■ ,a n ). 

Take an arbitrary s : F(Y) — > F(.X"). Let X = {xi, • • • , x n }, and Y = {y\, ■ ■ ■ , y m }- Let 
s(Ui) = Wj(a;i, ■ • • ,x n ) = Wi- Take a constant map Sj = f^fo : — > The sequence 

si, ■ • • , s m depends on s and on the basis of Y. In this situation we denote 

s =y {s 1 ,---,s m ). 

We have also s a : H n — > i7 m , and : i? ra — > There is a relation between s a and sf, 

i = 1, • • • , m: 

s Q (ai, ■ • ■ ,a n ) = (its i (ai, • • • ,a n ), • • • , vrs° (ai, • • • ,a n )). 

Indeed, 

s a (ai, ■■■ ,a n ) = (wi(ai, • • • , a n ), • • • , w m (a u ■ ■ ■ ,a n )) = (vrs"(ai, • • • , a n ), ■ ■ ■ ,7rs° (ai, • • • ,a n )). 

This formula is a key working tool for the proof of the theorem. It was the reason to 
replace the category of affine spaces by the category of polynomial maps. 
Now we are able to prove the reduction theorem. 
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PROOF of Theorem 3. Let us return to the automorphism ip : 6° — > 0°. For every 
algebra F = F(X), X = {xi, • • • , x n } we will construct an automorphism ax '■ F — > F depending 
on The collection of such automorphisms will define <p as an inner automorphism. 

Consider morphisms = z^z^o : F° — > F, z = 1, • • • , n. We have ^(e«) = ip(v Xi )vQ, and let 
¥>(f Xi )(xo) = Hi = <p(si)(x) for every x G X°. Let F = {yi, • • • , y n }. From the proof of Proposition 
6 follows that if the variety 6 is hopfian then Y is also a basis in F. 

Define the automorphism ax '■ F — > F by the rule crx(^i) = yi- 

Let s be an automorphism of the algebra F = F(X), and let s(xi) = Wi(x\, • • • , x n ) = Wj. 
Take u Wi : F -> F, i/^ = si/ Xj and let s, = i/^o = si/ Xj i/ = s£j. 

We have s =x (si, ■ ■ ■ , s„). We will check that ip(s) =y • • • , f(s n ). 

We have to verify that if tp(s)(yi) = w\ then ip(si)(x) = w\ for every x G X°. Compute 

¥»(a)(j/i) = ^(s)^(^J(^o) = <p(sv x .)(x ) = (p(u Wi )(x ) = 

= y{v Wi )vo(x) = ip(v Wi )(p(vo)(x) = ip{vwiVo){x) = <f(si)(x) 

for every x G X°. Thus, ip(s)(yi) = w' i = ip(si)(x) for every x G X . 

This implies ip(s)a x =x (f(si), ■ ■ ■ ,<p(s n ). Indeed, ip{s)a x {xi) = f(s)(yi) = (p(si)(x) for 
every x G -X" . 

Consider the image of the formula Si = ip(si)/j,x, i = 1, • ■ ■ , n in the category of polynomial 
maps Pole(H). 

Take the diagram 

Hom(F(X),H) Hom(F(X),H) 



a x 



We have got a map fi x = ax^xo^l ■ H n —> H n . In particular, fi x0 = ajo/ixa^. By 
the condition of Theorem, fi x o = 1 and n x0 = 1. 

Since, (f H (s) = fixsfi^ 1 = <p(s) for <p(s) : F(X) — > F(X) the following equality holds 

For Sj : F° — > F we get si = ip(si)^x and hence, 

= axosjax 1 = a x° ^{s^a^ax^xa^ = (p(si) a fi x , 

where sf = (p(si) a /j. x are polynomial mappings from H n to H k . For a = (ai, • • • , a n ) G i?" we 
have 

s a (ai, • • • ,a n ) = (7rsi(ai,---,a n ),---,vrs"(ai,---,a n )) = 
= (^(si) a Mx( a i; ■ ■ ■ > a «)> ■ ■ ■ > vrv9(s n ) a ^(ai, • • • , a n )). 
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Take 



and apply this formula to the point fi x (a±, ■ ■ ■ , a n ). Then 

(ip(s)a x ) a (vx(.ai, an)) = (ir<p{si) a [i x (ai, • • • , a n ), • • • , 7rip(s n ) a n x (ai, • • • , a n )) = s a (a). 
Thus, s a (a) = ((p(s)ax) a l~ixi a )- Since this formula holds in every point a then 

s a = (ip(s)ax) a ^x = VxV{sT»x- 

Hence, [i\ = (ip(s)- 1 ) a (a x 1 ) a s a = (sa^ 1 ip(s)~ 1 ) a . 

Denote £x = sa x 1 ip(s)^ 1 . This is an automorphism of the algebra F = F(X) and [i\ = 
Therefore, £x = In particular, £x does not depend on the choice of the automorphism s. 
Let now an arbitrary S : F(X) — > F(y) be given. Then we have 



7 Automorphisms of the category of free Lie algebras. The proof 
of the main Theorem 

Return to the variety of all Lie algebras over an infinite field. We want to prove that every 
automorphism of the category 0° is semi-inner. 

PROOF of Theorem 1. This variety 6 is hopfian and is generated by the free Lie algebra 
-F = F(x,y) [6]. It is clear that condition 2 is also valid. Thus, the conditions from section 6 are 
fulfilled. Therefore, the variety 6 is hereditary. 

It is enough to consider automorphisms ip which do not change objects [19]. Take such 
if and induce the automorphism tp F o of the semigroup End(F°). According to Theorem 2 such 
automorphism is semi- inner and is defined by the semi- automorphism (a, s F o) : F° — > F°. For 
every algebra F = F(X), which is distinct from F° take a semi-automorphism (a,a F ) ■ F — > F. 
Semi-automorphisms (a, s) F o = (a,s Fo ) and (a,s) F = (a,a F ) define a semi-inner automorphism 
ip of the category 6°. This ijj does not change objects. Automorphisms ip and ip act in the same 
way on the semigroup End(F°). Thus, the automorphism tpi = V>~V ac ts on End(F°) identically. 



(p H (5) = nxSfJ-y 



i 



tYSty 1 = iy l 5tx = <p(6) 




□ 
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Take a constant morphism u : F° — > F with vq(x) = ^o(y) = £o- Let us verify that 
(^i(fo) is also a constant. Take an automorphism 77 of the algebra F° defined by r](x) = y, rj(y) = x. 
We have v$r\ = uq. Therefore y>i(vorj) = Lpi(vo)ri = (^i(fo)- Hence, ipi(i'o)(x) = (pi(vo)r](x) = 
(pi(vo)(y) = ax for a ^ 0. 

Automorphisms of free Lie algebras: fF (xo) = axo and fp{x) = x for x <G X, F = 
F(X) / Fo, define an inner automorphism / of the category 6°, which does not change objects. 
Observe that isomorphism fp acts trivially on F°. We have f(vo) = fF ^ofpo and 

f{vo){x) = fF i^ofpo(x) = Jf M x ) = fF {xo) = ax , 

Thus, 99i(fo) and /(fo) coincide. Therefore / _1 Vi( t/ o) = ^o- Denote f~ l ip~ l ip = ipo. Then 

^0(^0) = ^0 an d ipo acts trivially on End(F(x, y)). By Reduction Theorem the automorphism ipo 

is inner. We have got ip = ipftpo = <5"0i/V'o- 

Thus, ip is semi-inner and the theorem is proved. □ 
Along with the automorphisms of categories of free algebras of varieties it is natural to 

consider also the autoequivalences of these categories (see Section 1). Let (<p,ip) be an autoe- 

quivalence of the category of free Lie algebras. We call it semi-inner if the functors <p and ip are 

semi-isomorphic to the identity functor. 

It was proved in [38], that for every and every autoequivalence of the category 

0° there are factorizations 

(p = (p pi, V = ¥1 Vo, 

where (fo and V'o are isomorphic to the identity functor and ipi is an automorphism. 

This means that every autoequivalence is isomorphic to an automorphism. This remark 
and Theorem 1 lead to the following statement: 

Theorem 4 Every autoequivalence of the category of free Lie algebras is semi-inner. 

In the introduction we discussed the categories of algebraic sets Kq(H), H € 0. The 
two problems were pointed out, namely, the problem of isomorphism of categories Kq{H\) and 
Kq{H2) and the problem of equivalence of the same categories. For the variety of Lie algebras and 
algebras R\ and H2, satisfying Var(Hi) = Var(H2) = 0, the first problem is solved in [32] with the 
aid of Theorem 1, while the solution of the second problem also in [32] requires arguments from 
Theorem 4. 

Appendix 

In this section we prove two propositions we have referred to in the text. 
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Remind that contravariant functor $ : 6° — > Kq(H) assign Hom((F(X),H) to any 
F(X) € 6° and for any s : F(Y) -► it assigns s : Hom((F(X),H) -> Hom((F(Y), H) 

denned by the rule s{y) = us. 

Proposition 8 The functor $ : 9° -> de/i nes a duality of categories if and only if 

Var(H) = 6. 

Proof. In our case the duality of categories means that if s±, S2 morphisms F(Y) — > F(X) then 
s i 7^ s 2 implies si ^ S2- Let si 7^ S2 and assume s\ = §2- Take y £ Y such that si(y) = w\, 
s 2(y) = W2, and w\ 7^ 1^2- Show that the non-trivial identity w\ = u>2 is fulfilled in algebra H. Take 
an arbitrary v : F(X) — > H. The equality Si = S2 yields s\{v) = s~2{v). We have also us\ = VS2- 
Apply this equality to y. We get vsi(y) = v(wi) = vs2{y) = v{w2)- Since v is arbitrary, we get 
that s\ = S2 implies w\ = w 2 in H. 

Assume that Var(H) = 0. Then there are no non-trivial identities in H. This means that 
the equality si = S2 does not hold in Kq(H). We proved that if Var(H) = then s\ 7^ S2 implies 
s\ 7^ s~2 and we get a duality of categories. 

Conversely, let us prove that if Var(H) 7^ then there is no duality. Since Var(H) 7^ 
there exists a non-trivial identity w\ = W2 in H, where wi,W2 in some F(X). Take Y = {yo}. 
Consider s± and S2 from F(Y) to F(X) defined by the rule: si(yo) = w ii s 2(yo) = w 2- Show 
that si = S2- This will mean that there is no duality. Take an arbitrary v : F(X) — > H. Then 
si(u) = us\, s 2 (u) = us 2 , both F(Y) — > H. Take y - Then usi(y ) = v{w\), usi(y ) = v{w2). 
Since w\ = u>2 is an identity in H then v{w\) = v{w2) and correspondingly, ^si(yo) = ^2(2/0)- 
Since the set 1" consists of one element yo then vs\ = us2- This equality holds for every v and 
therefore, si = S2- □ 

Proposition 9 Lei £/te variety 6e hopfian, ip an automorphism o/0° and vK-^b) *s isomorphic 
to Fo. Then <p(F) is isomorphic to F for every F = F(X). 

We use some new notions to prove Proposition 9. 

Definition 7.1 Let X be a set in a free algebra F = F(Y). We say that X defines freely algebra 
F if every map fio : X — > F can be extended uniquely up to endomorphism \i : F — > F. 

Remark 7.2 In many cases the notions "to define freely" and "to generate freely" coincide. For 
instance, this is true for the variety of all groups (E. Rips, unpublished). If this is true for the 
variety of Lie algebras we do not know. 

Lemma 7.3 Let the variety be hopfian. Let \X\ > \Y\. Then X defines freely F = F(Y) if and 
only if X is a basis in F and \X\ = \Y\. 
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Proof. Take an arbitrary surjection fi : X — > Y. If X defines freely F then there exists 
surjective endomorphism fi : F — > F. Since F is hopfian, fi is automorphism. Then fi is a 
bijection. The inverse bijection defines the inverse automorphism. Therefore, \X\ = \Y\ and X is 
a basis in F. The "only if" part is evident. □ 

For the sake of self-completeness we repeat some material from [5]. Take a free algebra 
F = F(X) and consider a system of morphisms : Fq — > F, % = 1, • • • , n. 

Definition 7.4 A system of morphisms (e±, ■ ■ ■ , e n ) defines freely an algebra F if for every sequence 
of homomorphisms f±, ■ ■ ■ , f n , fi : Fq — ► F there exists a unique endomorphism s : F — > F such 
that fi = sei where i = 1, • • • , n. 

It is proved in [5] that the system (ei, ■ • • , e n ) defines freely F if and only if the system of 
elements (e\(xo), • • • , e n (xo)) defines freely algebra F. It is obvious, that if the system (ei, • ■ ■ , e n ) 
defines freely F then the system (</?(ei), • • • , ¥>(e n )) defines freely <p(F) if <p(Fq) = F(yo). 

PROOF of Proposition 9. Let the variety 6 be hopfian, (p(F ) = F(y ). Let f(F) = 
F(Y) where F = F{X). We prove that algebras F(X) and F(Y) are isomorphic. 

Let, first, \X\ > \Y\ and X = {x\, • • • , x n }. Define the system (ei, • ■ ■ , e n ) by the condition 
£i(xo) = Xi, for every i. This system defines freely algebra F. Then the system (y(ei), • • • , f(e n )) 
defines freely algebra tp(F) = F(Y). This means that the set Y' of elements y[ = ip(ei)(yo) 
defines freely algebra F(Y). Since \Y'\ = \X\ > \Y\ then the system Y' is a basis in F(Y) and 
\Y'\ = \X\ = \Y\. The map Xi — > y[ defines the isomorphism of algebras F(X) and F(Y). 

Let now \X\ < \Y\. Then F(X) = Lp(F{Y))^ 1 . Applying the same method to the 
automorphism tp^ 1 we get the contradiction. □ 

References 

[1] Yu.Bahturin, Identical relations in Lie algebras. VNU Science Press, Utrecht, 1987. 

[2] G.Baumslag, A.Myasnikov, V.Remeslennikov, Algebraic geometry over groups, J. Algebra, 
219 (1999), 16 - 79. 

[3] G.Baumslag, A.Myasnikov, V.Remeslennikov, Algebraic geometry over groups, in book "Al- 
gorithmic problems in groups and semigroups", Birkhauser, 1999, p. 35 - 51. 

[4] A. Berzins, Geometrical equivalence of algebras, International Journal of Algebra and Com- 
putations, 11:4 (2001), 447 - 456. 

[5] A. Berzins, B.Plotkin, E.Plotkin, Algebraic geometry in varieties of algebras with the given 
algebra of constants, Journal of Math. Sciences, 102:3, (2000), 4039 - 4070. 



21 



[6] L.Bokut, G.Kukin, Algorithmic and combinatorial algebra, Kluwer, 1994. 

[7] P.M. Cohn, Subalgebras of free associative algebras, Proc. London Math. Soc. 14 (1964), 618- 
632. 

[8] P.M. Cohn, Free rings and their relations, Academic Press, 1985. 

[9] A.Czerniakiewisz, Automorphisms of a free associative algebra of rank 2. II. Trans. Amer. 
Math. Soc. 171 (1972), 309 - 315. 

[10] J.Dyer, E.Formanek, The automorphism group of a free group is complete. J. London Math. 
Soc. (2), 11:2 (1975), 181 - 190. 

[11] J.Dyer, E.Formanek, Characteristic subgroups and complete automorphism groups. American 
Journal of mathematics, 99:4 (1977), 713-753. 

[12] E.Formanek, A question of B.Plotkin about semigroup of endomorphisms of a free group, 
Proc. Amer. Math.Soc, 130 (2002), 935 - 937. 

[13] L.Gluskin, Automorphisms of multiplicative semigroups of matrix algebras, Uspehi Mat. Nauk 
(N.S.) 1(67):11 (1956), 199-206. 

[14] Kourovka notebook. Non solved problems of the group theory. Problem 4-9, Novosibirsk, 1973. 

[15] R.C.Lyndon, P.E. Shupp, Combinatorial group theory, Springer, 1977. 

[16] O.Kharlampovich, A.Myasnikov, Irreducible affine varieties over a free group. I: irreducibility 
of quadratic equations and Nullstellensatz J. of Algebra, 200: 2, (1998) 472 - 516. 

[17] O.Kharlampovich, A.Myasnikov, Irreducible affine varieties over a free group. II: J. of Algebra, 
200: 2, (1998) 517 - 570. 

[18] L.Makar-Limanov, The automorphisms of the free algebra with two generators. (Russian) 
Funkcional. Anal, i Prilozen. 4 1970 no. 3, 107 - 108. 

[19] G.Mashevitzky, B.Plotkin, E.Plotkin, Automorphisms of categories of free algebras of vari- 
eties, Electronic Research Announcements of AMS, 8 (2002), 1 - 10. 

[20] G.Mashevitzky and Boris M.Schein, Automorphisms of the endomorphism semigroup of a free 
monoid or a free semigroup, submitted to Proc. Amer. Math. Soc. 

[21] S.MacLane, Categories for the working mathematicians, Springer, 1971. 

[22] A.Myasnikov, V.Remeslennikov, Algebraic geometry over groups I, J. of Algebra, 219:1 (1999) 
16 - 79. 

22 



[23] A.Myasnikov, V.Remeslennikov, Algebraic geometry over groups II, Logical foundations J. of 
Algebra, 234:1 (2000) 225 - 276. 

[24] O.O'Meara, Lectures on linear groups, Providence, 1974. 

[25] M.Nagata, On the automorphism group of k[x, y], Lectures in Math, Kyoto Univ., Kinokuniya, 
Tokyo, 1972 

[26] D.Nikolova, B.Plotkin, Some notes on universal algebraic geometry, in book "Algebra. Proc. 
International Conf. on Algebra on the Occasion of the 90th Birthday of A. G. Kurosh, Moscow, 
Russia, 1998" Walter De Gruyter Publ., Berlin, 1999, 237 - 261. 

[27] B.Plotkin, Algebraic logic, varieties of algebras and algebraic varieties, in Proc. Int. Alg. Conf., 
St. Petersburg, 1995, St. Petersburg, 1999, p. 189 - 271. 

[28] B.Plotkin, Varieties of algebras and algebraic varieties Israel. Math. Journal, 96:2 (1996), 511 
- 522. 

[29] B.Plotkin, Varieties of algebras and algebraic varieties. Categories of algebraic varieties. 
Siberian Advanced Mathematics, Allerton Press, 7:2 (1997), p.64 - 97. 

[30] B.Plotkin, Some notions of algebraic geometry in universal algebra, Algebra and Analysis, 
9:4 (1997), 224 - 248, St.Peterburg Math. J., 9:4, (1998) 859 - 879. 

[31] B.Plotkin, Seven lectures on the universal algebraic geometry, Preprint, (2002), Arxiv:math, 
GM/0204245, 87pp. 

[32] B.Plotkin, Algebras with the same algebraic geometry, Proceedings of the International Con- 
ference on Mathematical Logic, Algebra and Set Theory, dedicated to 100 anniversary of 
P.S.Novikov, Proceedings MIAN, (2002), to appear 

[33] V.Tolstykh, The automorphism tower of a free group, J. London Math. Soc. 61 (2000), 423 - 
440. 

[34] V.Tolstykh, Free two-step nilpotent groups whose automorphism group is complete Math. Proc. 
Cambridge Philos. Soc. 131 (2001), no. 1, 73 - 90. 

[35] B.Schein, B.Teclezghi, Endomorphisms of finite full transformation semigroups, Proc. of the 
American Math. Soc. 126 (1998), 2579-2587 

[36] J.Schreier, Uber Abbildungen einer abstrakten Menge auf ihre Teilmengen, Fundamenta 
Mathematica 28(1936), 261-264 

[37] Z.Sela, Diophantine geometry over groups I, IHES, 93, (2001), 31 - 105. 



23 



[38] G. Zhitomirskii, Autoequevalences of categories of free algebras of varieties, to appear. 



24 



